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Abstract In Bayesian theory, calculating a posterior probability distribution 
is highly important but usually difficult. Therefore, some methods have been 
put forward to deal with such problem, among which, the most popular one is 
the asymptotic expansions for posterior distributions. In this paper, we propose 
an alternative method, named random weighting method, for scaled posterior 
distributions, and give an ideal convergence speed, which serves as the theoretical 
guarantee for methods of numerical simulations. 
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1 Introduction 

Bayesian inference has made a great progress in the past forty years, including theoretical researches 
and practical applications in many fields. The dispute between Bayesian and frequentist schools, 
about how to choose prior distributions, is almost disappearing. Now the main issues of Bayesian 
statistics are determining the prior probability distributions and calculating the posterior probabil- 
ity distributions, of which the latter one is more important. For the comprehensive reviews on the 
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Bayesian statistics, see the monographs of Lindley (1972), Dey and Rao (2006), and the references 
therein. 

Let X = (X\, ■ ■ ■ ,X n ) be an i.i.d. sample from a univariate distribution F(x,9), 9 G O, where 
is an open interval on 1Z and 9 is regarded as an unknown parameter to be estimated. In Bayesian 
statistical inference, we assume that 9 is random with a prior distribution, say v{9). After taking a 
simple random sample X from the conditional distribution F(x\9) of X given 9, Bayesian analysis is 
carried out based on the posterior distribution F(9\X) given X. For the parametric family F(x,9) 
indexed by parameter 9 and for a given prior, the posterior distribution F(9\X) can be obtained 
explicitly merely when the prior has a specific form or has a simple form, such as a conjugate prior 
or an uninformative one. Generally, the calculation of the posterior distribution is difficult and 
involved. To handle this problem, some researchers have studied asymptotic expansions for posterior 
distributions, see Johnson (1967), (1970), Ghosh et al. (1982), or approximate calculations, see Mao 
and Tang (1989), Tierney et al. (1986), and some suggested numerical solutions. 

In this paper, we provide an alternative method to deal with the problem of approximating 
the posterior distributions. In terms of the idea of the so-called random weighting method (Zheng, 
1987), we propose a random weighting method to approximate the standardized posterior distri- 
butions. We prove that the approximation possesses the ideal convergence speed. The merit of 
random weighting method can approximate the sampling distribution in frequentist statistical anal- 
ysis. The construction of the random weighting approximation for the posterior will be postponed 
to the Section 2. In terms of the approximate theorem in section [2j we can understand the ap- 
proximation of the posterior distribution from frequency point of view. This makes it possible to 
calculate the posterior distribution without iteration like Monte Carlo Markov Chain technique. 
The essence of the random weighting method is to construct random weights which may sample 
from the various Dirichlet distributions. To get better approximation of the distribution, we need to 
design different weighting method for different purposes. For detailed investigations on the choice 
of the random weight under some specific situation, we refer to the monograph of Shao and Tu 
(1996) and the references therein. 

The paper is organized as follows. We present the regularity conditions and the main results in 
section [2j And as the conclusion, we present some discussion in section [3l The proofs of the main 
theorems are given in the Appendix. 
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2 Conditions and the Main Results 



First of all, to make the problems under study meaningful, the following regularity conditions are 
needed. 

Let X±, ■ ■ ■ , X n be i.i.d. random variables having a common c.d.f. F(x, 9), 6 £ 0, where is an 
open interval on TZ. Suppose f(x, 9) is the p.d.f. of F(x, 9) with respect to some u-finite measure /i. 
Assume that the parameter 9 has a prior, whose p.d.f is v(Q) with respect to the Lebesgue measure. 
A closed interval [ao,&o] C 0, with ao < bo, satisfies that 



v{6) = { 



> 0, 6 G (a ,b ), 

= 0, 9e(a ,b ) c . 
Let c < ao,d > bo, such that [c,d] C 0. Further, we need the following assumptions: 
Al. For each 9 G [c, d], f(x, 9) is measurable with respect to x. 
A2. For each 9,9' G [c,d], where / 0', we have / \f(x,9) - f(x,9')\fi(dx) > 0. 
A3. For each x, f(x,9) is four times continuously differentiable in 6 G [c, d]. 
A4. For each 9 G (c,d), there exits a neighborhood Ug of 0, and a measurable function Mi$(x), 
(i = 1,2,3,4), such that 



SUp Eg 

0>eu e 



4+a 



±Ao g f(x,e')--^-Aogf(x,e" 



< oo, i = 0, 1,2,3,4, 
< |#'-0"|M ie (x), 



and 



3+a 



< OO, 



sup Eg,(M ie ,(x)) 
O'eu 

where a is a positive constant and i = 1, 2, 3, 4. 
Besides, for any G (c, ci), we assume that 

/(0) = £ e (-^iog/(M))>o, 

£ e (^log/(*,#)) = 0, 

with 1(9) being continuous on [c, d]. And for any 6* G [c,d], & G (c, d), there exist neighborhoods 
Vg and Wgi , such that each neighborhood V C Vg satisfies that 

sup E a \ suplog/(x,/3)| 3+a < oo. 
aew' p&v 



A5. u{9) is twice continuously differentiable on [ao,&o]- 

All these assumptions are reasonable and standard (Pfanzagl, 1973; Ghosh et al, 1982). Now 
we present our main theorems as follows. 

Theorem 2.1 Under conditions Al to A5, we have 

lim sup \F n (y)-*(y)-A(y,X.. n /,/n)\ = a.s.P v , (2.1) 

where X. n = (X u --- ,X n ), F n (y) = P{^{6 - 6 n )b < y|X_ n }, = ^= exp(-^)^ ; 

<f)(y) = -^=exp( — \), 8 n denotes the maximum likelihood estimator (m.l.e.) of 9, (—b 2 ) is th 



e 



value of the second order derivative of log likelihood function at 9 n , P u is the marginal probability 
measure of X\ under the prior p. d.f. v, and 

A(y,X_ n ) = -0(y)^(0 n )]- 1 [6- 3 a n (^)z,(0 n )(y 2 + 2) + 6-V , (^)], 
AO) = ±v{ff), ^ 

i=i 

The proof of the theorem above can be derived directly from Theorem 2.1 of Ghosh et al (1982). 
In fact, the F n {y) in Theorem 12.11 is the standardized posterior c.d.f. For now, our goal is to 
construct a random weighing statistic, whose c.d.f. F*(y) can approximate F n (y). 
Let 

k n (y) = P*{H n /H n < y}, (2.3) 



with 



3=1 



1 n 



n(4n + 1) ^ 
i=i 

a 3 = -lZ l °Sf(xj,9 n ), j = l,---,n, a = -S2aj, 
a9 n z — ' 

3 =1 

where (Vi, • • • , V n ) is a random vector with the Dirichlet distribution D(4, 4, • • • ,4), i.e., V\ + • — h 
V n = 1, and the joint p. d.f. of (Vi, • • • , V n -\) is 

f(x!, ■■■ , X n -x) = X l " " " X n-\( l - X l X n ^if, (x 1} • • • , X n _i) G S^-l, (2-5) 



with S n -i = {(xi, • • • , x n _i) : Xj > 0, Y^j=i x j — !}• " " " > Vn) and X- n are independent, and 
letters with asterisks, such as P* and .F* above, denote conditional probability and conditional 
c.d.f. given X\,--- ,X n . From the theories of Dirichlet distribution given in Wilks (1962), if 
Zx,-~ , z n ~ i.i.d.f(x), where /(x) = T ^(2x) 3 e~ 2x I^ !>( ^, then each Zi/(Yd=i Zi),i = ,n, 
has a Dirichlet distribution D(4,4, • • • ,4), thus the statistic H n can be rewritten as 

j=l i=l 

Where = stands for equality in distribution. And the H 2 above turns out to be conditional variance 
given Xi, ■ ■ ■ ,X n . Hence, 



if 



P*{H n /H n <y} = F*{£(a< - a) V(1^J) < I/An} 

i=i 1=1 
n 

= P*{J2Bin(y)(Zi-2)<p n (y)}, (2.7) 



i=l 



with 



B m (y) = A in (y)/^2A 2 jn (y))^ 2 , i = !,-■■ ,n, 
^in(y) = «i - a - y.ff n , 

n 

p„(y) = -2^ J B m (y). (2.8) 

i=\ 

Denote pi n = {Z{ — 2)Bi n , i = 1, ••• ,n, then they are a sequence of independent random 
variables(r.v.s) given 



Theorem 2.2 Suppose that conditions Al to A5 are all satisfied, and H n is given by \2.J$ , then 

km ^ sup \P*{H n /H n <y}- <%) + -U(y)(y 2 - 1) ^= l( ^ ~ | = (2.9) 

/ioWs /or almost every sample sequence X\, ■ ■ ■ ,X n . 
Again, let 

F*{y) = P*{cj n (H n /H n ) < y}, (2.10) 

where 

u n {y) = {y- Pn/Vn~) - P'JV^iy - /Vv^) 2 + fin/My - /Vv 7 ^) 3 , (2.11) 
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with 

(3 n = -2b-\ n {9 n ) - 6-V(* B )M* B ) - l^ ^^-^f/^ 

Pn = -b- 3 a n (9 n ) + l^ ,^=} {ai \% /2 . (2.12) 

Thus, we can use F*(y) to approximate F n (y). We have the following conclusion on the precision 
of this approximation. 

Theorem 2.3 Assume that conditions Al to A5 are all met, then 

lim ^ sup \F n (y) - F*(y)\ =0 (2.13) 

n ^°° -oo<j/<oo 

is true for almost every sample sequence. 



3 Concluding remarks 

Finally, we point out that the approximate value of a posterior distribution can be calculated by 
Monte Carlo method, and the purpose of this paper is to offer a theoretical guarantee for such 
simulation. The random approximation method for posterior distribution can be used to deal with 
more complicated problems involved in the computation of posterior distribution. The advantage 
of the method of this paper is easily implemented via computer. However, it is difficult to obtain 
the closed form except some special parametric family. Some extensions of the method of this paper 
to multivariate situations may be possible and are beyond the score of this paper. Furthermore, 
we can provide better approximation to posterior moments. 
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Appendix: Proofs of Theorems 

In this section, we present the proofs of Theorem 12.21 and Theorem 12,31 in section [2J 
From the definitions of F* and k n , we can easily obtain 

F:(y) = k n (u J ~ 1 (y)), (3.1) 

where u~ l (y) = u n (y) is the inverse function of uj n (y), which is given by (|2,lip and strictly monotone 
on (— oo, oo) with range (— oo, oo). Following the line of Yao (1988), we can prove that this u n takes 
the form 

u n (y) = -^P n + y + -^P' n y 2 (l + o(l)), (3.2) 
Jn Jn 



where o(l) stands for an infinitesimal as -^y — > 0. 

To prove Theorem 12.21 and Theorem 12.31 we need to asymptotically expand k n (y). 
Notice (|2.7p . together with Theorem 1 of Bai et al. (1985), we have 



\P*{H n /H n <y}- $( Pn (y)) + \<j>{p n {y)){pl(y) ~ 1) J>?J 

n n 
< C{(1 + \p n (y)\)- 3 £ E *\Wjn(Pn(y))\ 3 + (1 + |Pn(y)|)~ 4 £ E*\Z jn {p n {y))\' 
3=1 3=1 



+ (1 + \pn{y)\T 4 n Q ( snp \ \V jn (t)\ + ^-)"} 



= c{J x + J 2 + J 3 ), (3.3) 

where Y jn = Pj n I{\ Pjn \<i}, Z jn (p n (y)) = PjnI{\ Pjn \<i+\p n ( y )\}, W jn {p n {y)) = PjnI{\ Pjn \>i+\p n (y)\}, 
Sn = j2 (E"=i E*\Y nj fy , V jn (t) = £* e «W» = exp{-2tt5 in }(l - itB jn /2)-\ with j = 1,- ■ ■ ,n 
and E* being the conditional expectation given Xi, ■ ■ ■ , X n . 
Next, we will prove that 

lim Jn sup Jj = 0, i = l,2,3, (3-4) 

n ~>°° — oo<j/<oo 

hold for almost every sample sequence Xi, ■ ■ ■ , X n . 
Simple calculation implies that 



P 



■ n (y) = 2Jny/j , An+l + y*. (3.5) 
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Now, we study the asymptotic prosperity of each term on the right side of (|3.3p . Begin with 
the definition of Bj n , we get 



B jn (y) = (ptj -a- yB n )/[(l + y 2 /(4n + I)) 1 /* ~ «?) 1/2 \- 

3=1 



Hence, 



/2 



max sup \Bj n (y)\ 

1<3<« -oo<y<oo 

n n 1 

< max \ aj \/Q2(flJ ~ «) 2 ) 1/2 + N/(5>* " «) 2 ) 1/2 + SU P ^/ n ( 4n + + r— T y2 ^ 
i<3<™ r-f r— : -oo<«<oo 4n + 1 

3=1 3=1 

1 n 1 1 n 

< max |«i|/V^/[- £(«J - a) 2 ] 1 / 2 + -r=|a|/[- E( a J " «) 2 ] V2 + Vv^- ( 3 - 6 ) 

- J ~ n 3=1 V 3=1 



Since 



max |aj | = -= max | — log f(xj, 9 n )\ 



< — max | — log f(xj, i 



1 . d 

_ ....... , , , -= max — 

\fn i<j<n J i/n i<j<n d6 

1 . d 

-j= max — 

\Jn i<j<n dO 

+ -7= max |-^-log/(x,-,0 n ) - -^-log/^v 
/n i<3<« do da 

—= max I — log f (xj,9)\-\ , ....... 

y/nl<j<nd6 &Jy V ' ] y/n 1 !<3'<n 



< — ^= max | — log/(xj, 9)\ H — = |# n — 0| max Mig(xj,9), (3.7) 



^ log f(xj,6), j = 1, • • • , n is a sequence of i.i.d. r.v.s, and Condition A4 shows that E\-jjjg log f(X, 9)\ A < 
00, it follows from the the standard limit theorem that 



d 

>oo l<j<n ' dO 



lim max | — log /(ay, 0)|/\/n = a.s. (3.8) 



Condition A4 also implies that EMf s (X,9) < 00, and on the conditions Al to A4, making use of 
the method suggested by Pfanzagl (1973), it can be derived that the m.l.e. sequence of 6, i.e. 6 n , 
is strongly consistent, thus 

lim —=\9 n — 6\ max Mig(xj,9) = a.s. (3.9) 

n— >oo y/fi l<j<n 



370) to J32D Kive 



lim — p= max |a 7 -| = a.s. (3.10) 

n-s>oo yjn l<3<n 



8 



Besides, we need to prove that 

lim o = a.s. (3.11) 

and 

1 n d 
lim -Y^( aj -a) 2 = E(— logf(X,9)) 2 >0 a.s. (3.12) 
n->oo n t-^ J da 
i=l 

The proof of (|3. 11 [) is presented as follows. 
Since 

n ^-^ a0 

i=i 

i=i i=i 

from Condition A4 and strong law of large numbers comes that 

1 n d d 

lim - E la lo § A 3 *' °) = E l~a lo § ^ = a - s - 
n-><x> n t—' dd dd 

3=1 

as well as 

1 n 

lim - V M w (xi, 9) = EM W (X, 9) < oo a.s. 

n— >-oo 77, ^— ' 
J'=l 

(|3.1ip holds from the fact that 9 n is a sequence of strongly consistent estimators of 9. 
Next, we prove (|3.12p . the details are given as below. 



\-^-af-E(-logf(X,9)f\ 

< |if;a/-^log/(X,e)) 2 | + |a| 2 
. n , , 

+ l~ E^ lo § /^'^) - ^ lo § /^i' lo § ) + ^ lQ g § n)]\ + |a| 2 ,(3.13) 

5=1 

together with (|3.1ip and strong law of large numbers, on the righthand side of (|3.13|) . both of the 
first and the last term converge to a.s. and the middle term can be easily proved to be also 
convergent to a.s.. Therefore, (|3.1ip and (|3. 12|) hold. 
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3.6|) . (|3.10p to (|3.13p combined together gives 



lim max sup \Bj n (y)\ = a.s. (3-14) 

n— 5>oo l<j<n y 



Now we are ready to prove ([3~ 
When i = 1, by strong law of large numbers, similar proof with that of (13. 11 f) and (|3.12p derives 
that 

n 

lim sup y/n \Bj n \^ < co, a.s. (3.15) 

n->oo _ 00 <„< 00 ^— ' 

Together with (|3.14p and (|3.15p . we have 
lim yfn sup J\ 

n ^°° — oo<y<oc 

n 

= lim sup (l + |p„(y)|)- 3 Vi?1^„(p„(y))| 3 

7i->oo -oo<y<oo r— f 

n 

= J^L^ sup ( 1 + l^(i')l)~ 3 Z) £7 *l^l 3i {i«»i>i+i^(v)[} 

j = l 
n 

= su p U + My)!) -3 ^!^"! 3 ^^ - 2 l 3/ {i^-2iiB J „i>i+iPn( J /)i} 

n— ruu _ oo<i/<oo . -, 

n 

" rf^o^ SUP ^ + \P^y)\)~ Z ^\ B 3n?E\Zj -2| 3 / { | Zj _ 2 |>(l+|p n (j / )|)/max 1 < J < n |B Jn |} 
— oo<v<oo . -, 

)i 

- .JSJ^" SUP Sl^jnl 3 ]^!^ " 2 | 3/ {^i-2|>(l+|Pn(y)|)/max 1<J<n |i? Jn |} 
ii—i-cv — oo<»/<oo . . 

= a.s. (3.16) 
When i = 2, by (l3T4|) and (ETISjl . we get 

n 

lim y/n sup J 2 = lim y 7 ™ sup (1 + |p n (y)|)" 4 V S*|Z in (p n (y))| 4 

n->oo -oo<y<oo n->cx> -oo<y<oo J~ J 



lim V™ sup (1 + \p n {y)\) 4 y^E*\p jn I { \ p | 



_ ^l<l + |Pn(y)|}! 4 

-00<H<00 . , 



< hm \fn sup (l + |p n (y)|) }E\pj n \ 

n-^-oo -oo<h<oo r— f 

3 =l 

n 

< lim v 7 ^ max sup | B jn (y)\ • V] |v3,- n (y)| 3 • E\Z\ - 2| 4 

n->oo l<i<n_ 00< „ <00 z — f 

= a.s. (3.17) 
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When % = 3, since 



^2 E *\ Y jn\ 3 = ^2 E *\pjn\ 3 I{\p jn \<l} 
3=1 3=1 



= £ \Bjn\ 3 E\Z 1 - 2|Z t | Zl _ 2 ||B Jn [< 1 } 

i=i 

n n 

< max sup \B jn {y)\-^B 2 jn (V#f n = l) 

^SjS n — oo<«<oo . -, . -, 

3=1 3=1 

= max sup \Bj n (y)\ — > a.s. 

l<j<n -oo<j/<oo 



we get 



1 

5n = — E^lljnl 3 )" 1 -> oo a.s. (3.18) 
i=i 

whose convergence is uniform in y G (—00,00). Besides, 



n 1 

lim sup J 3 = lim -v/n sup (1 + |pn(y)|)~ 4 ^ 6 [ sup V] |Vj„(i)| + — } n 

n->oo -oo<j/<oo n->oo -oo<j/<oo |i|><5n ~{ ln 



< lim n 7 sup [ sup - V |exp{-2iiS,- n }(l - it-B jn /2)- 4 | + — } n 
n-+oc -oo<y<oo [t|>5 n n ~[ 2n 

1 " 1 

= lim n 7 sup [ sup - £(1/(1 + t 2 B] n /A)f + -} n 
-oo< y <oo | t |>5„ n J 2n 

1 n I 1 

< lim n 7 sup [- V 1/(1 + 5%B%) + — ]» 

< limn 7 sup (1--4 +-Y\B jn \ 4 5 n + -) n , (3.19) 



"— x -oo<y<oo n n ~{ " 



and notice the term in the middle of the right side of f|3. 19|) 



4 



J'=l 



12 E"=i - 2|3/ {|B . n(z ._ 2)| < 1} 
< max j J — > a.s. 

l<j<n Y1E\Z\ - 2| d i{| Bjn (Z 1 -2)|<l} 

Meanwhile, it can be derived from axioms of probability theories that 

lim sup sup —^=S n < 00, 

n^oo -oo<j/<oo yn 

and 

lim inf inf — =8 n > 0. 

n^oo — oo<j/<oo ,/n 
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From these we know that there exits a constant c > 0, such that when n grows sufficiently large, 
almost every sample sequence has 

1 1 A 1 1 , _ n l/2 



(1 - -7= ■ -7=$ + - + - E \ B Jn\ 4 Sn) n < 
\Jn \Jn n n z — ' 



i=i 
therefore, 

lim \fn sup J3 = a.s. (3.20) 

n ^°° — oo<2/<oo 

Recall (I3TT61) . (I3TT71) and (l330|) . it can be inferred that ([33]) true. 

To summarize what has been mentioned above, we have Lemma 13.11 as below: 

Lemma 3.1 If conditions Al to A5 are all satisfied, then for almost every sample sequence X%, ■ ■ ■ ,X n , ■ ■ ■ , 
we have 

_ 1 n 

lim ^ sup \P*{H n /H n <y}- ${p n {y)) + -Hpn(y))(pl(y) - 1) V B%\ = 0. (3.21) 

rwo ° -oo<y<oo — , 

Lemma 3.2 (See Tu and Zheng (1987) ) There exits a constant c > 0, such that 

sup M P n(y)) - *(y)\ < c/n, (3.22) 

— oo<j/<oo 

sup \<P( Pn (y))(p 2 n (y) - 1) - <Xy)(y 2 - 1)| < c/n. (3.23) 

— oo<j/<oo 

The proof of Theorem 12.21 is as below. Let 

n n 

^ = E( a r«) 3 /(E(«r«) 2 ) 3/2 , 

i=i j=i 



r„ = E( a i - « - 2/^n) 3 /(E^ a J ~ a ~ y-^n) S 



^3/2 

j=i j=i 

Since 



sup \P*{H n /H n <y}- $( y ) + -U(y)(y 2 - l)r„| 

— oo<y<oo D 

1 ™ 

< v 7 ^ sup |P Jr {^ n /^<y}-1>( / 9 n (y)) + - ( />( / 9 n (y))(p2(y)_l)^i?3j 

— oo<f/<oo . 

1 n 

+Vn~ sup |$(p n (y)) - $(y)| + sup \-[<P(y)(y 2 - 1) - ^(p n (y))(p 2 n (y) - l)]^ B^ n \ 

— oo<j/<oo — oo<y<oo O 



y>(4n+l)V4 6 j=l 
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I n 

+ sup [|-^(y)(y 2 -l)K|r n | + |E^n, 



+ sup h0(y)(y 2 -i)\[\r n \ + \Y, B jn\] 

+ V™~ sup |^(y)(y 2 -l)||r n -f n |. (3.24) 

\y\<{in+l) l / A D 

It can be derived from Lemma 13. II and Lemma 13.21 that the former 3 terms on the right side of 
(|3.24p are convergent to for almost every sample sequence X% , ■ ■ ■ , X n . 
When y > (4n + l) 1 / 4 , ^cp(y)(y 2 — 1) is monotonically decreasing and 

lim ~<K(4n + l) 1/4 )((4n + l) 1 / 2 - 1) = 0, 

71— »00 6 

with (|3.15p . we know that the fourth term of the right side of (|3.24p is convergent to for almost 
every sample sequence X\, • • • , X n , • • • ,. The similar method can be applied on the fifth term. As 
for the last term, notice that 

sup \4>{y){y 2 - 1)1 < oo 

— oo<j/<oo 

and the definition of H n , it is not difficult to prove that 

y/n sup \r n - f n \ 
| !/ |<(47i+l) 1 /4 



iyi<(Si)V4 (i E -=iK - «) 2 ) 3/2 [i E"=i(«j - «) 2 + d£i • £ E"=i(«j - «) 2 F /2 

Thus the proof of Theorem 12.21 is complete. 
The proof of Theorem 12.31 is given as below. 
(|3.ip implies that 

F*(y) = k n {u n {y)) = P*{H n /H n < u n (y)}. (3.25) 
And from Theorem I2.2| for almost every sample sequence X\, ■ ■ ■ ,X n , • • • , we have 

lim Vn sup \F*(y) - $(u n {y)) + -^(u n (y))(u 2 (y) - l)r n \ = 0. (3.26) 

rWOO -oo<j/<oo O 

Using ()2.ip of Theorem 12.11 gives that 

lim y/n sup \F*(y) - F n (y)\ 

n ^' 00 — oo<y<oo 

= lim y/n sup \${u n (yj) - \(f)(u n (y))(u 2 n (y) - l)r n - $(y) 

n^oo -oo<y<oo O 

+^(y)[2b- 3 a n (9 n ) + b~ l v' (6 n ) /v(6 n ) + r 3 a n (0 n )y 2 ]| 
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< lim V™ sup Mu n (y))--<j>My))(u*(y)-l)r n -$(y)--=A(y,X- n )\ 

n-s>oo i b \/n 

\y\<nTI v 

+ lim y/K sup |*(«n(y)) - -U(u n (y))(u;;(y) " l>n - - -pA(y, X_ n )| 

y>nT2 v 

+ lim sup |$K(y)) - - IK - - -rMv>X-n)\ 

y<-nTl v 

= /x + Ia + Is- (3.27) 

First, we deal with Ii. The mean value theorem states that there exit points £ and 77 between 
it n (y) and y, such that 

*(«n(l/)) - Hy) = <t>{y)(u n (y) - y) + R ln (3.28) 
^K(y))(^(y)-l)-0(y)(y 2 -l) = 0(y)(3y - y 3 )K(y) - y) + R 2n . (3.29) 

Recalling fl3jZ]), (1338]) and (^291) gives that 

h = lim v 7 ^ sup |$(u n (y))-$(y)--^(« n (y))(«^(y)-l)r n -^A(y,X_ n )| 

n-s>oo 1 b -v/re 

|j/|<nT2 v 

= lim ^fn sup |0(y)(u„(y) - y) + R Xn - \[(j){u n {y)){u 2 n (y) - 1) - <p{y){y 2 - l)]r n 

n— >oo 1 O 

|y|<ni2 

-^(y)(y 2 -l)r„--^4(y,X_ n )| 
6 x/n 



lim y/n sup |^(/>(y)y 2 [-6 3 a n (#„) + -y/nr n ]o(l) + 



n-»oo 1 -i/n D 

|j/|<nT5 v 

-^0(y)(3y - y 3 ){u n (y) - y)r n + R2 n r n \ 

6 

< lim sup \(/)(y)y 2 \\b~ 3 a n (8 n ) + -y/nr n \ sup |o(l)| 

n^f» 1 b 1 

|y|<nT3 |y|<nT2 

+ lim v 7 " sup I .Rin I + lim sup ^\(f)(y)(3y - y 3 )\\(u n (y) - y)\\^r n \ + lim sup |-R2n|Vw- n 

n— >oo 1 n— >oo i b ra— »oo i 

= hi + I12 + hs + hi- (3.30) 
Use Conditions A4, A5 and strong law of large numbers, it is easy to check that 

lim \b~ 3 a n (6 n )\ < 00 a.s. 

n— >oo 

lim ^/nr n < 00 a.s. > (3.31) 

n— ¥00 

lim \b~ 1 h>'(9 n )/v(0 n )\ < 00 a.s. 
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which can be either proved in the same way of that of (|3.1ip and (|3.12p or directly derived from 
Lemma 4 of [3]. 

When \y\ < nia , y/^/n — > 0, and it follows from the definition of o(l) that 

lim sup |o(l)|=0. (3.32) 

n~ >oo i 
\y\<nT2 

Notice that there exits a constant k > 0, such that 

sup < k < oo, i = 0,l,---,4. (3.33) 

— oo<y<oo 

Therefore, it holds from (|3.3ip to f|3.33j) that 

In = 0. (3.34) 

(I3.2p shows that 

I12 = lim -y/n sup \Ri n \ 

n— >oo i 
\y\<nTl 

= lim Vn sup \\i<t>(Q\\u n {y) - y\ 2 

n— >oo i z 

|j/|<nT3 

< k lim a/to sup |^/3 n + ^/3; y 2 (l + o(l))| 2 

n "°° |»|<»A ^ ^ 

< 2k lim(^|/3 n | 2 + |^| 2 - sup -L/(l + | (l)|)) 

v \y\<n^ v 

< + 2& lim \/3'\ 2 ■ —n&(l + sup |o(l)|) = 0. (3.35) 

n->oo ^/n 1 

M<™ 12 

Repeating the same argument gives 

Ii3 = 0, /i4 = 0. (3.36) 

(IBTM]) to imply that 

h = 0. (3.37) 

Concerning I3, notice that c/>(y)|y| l , (z = 0,1,2) are all monotonically increasing on (—00, 2) 
with 

lim <Ky)|yr=0, ^ = 0,1,2. 

y— >oo 
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And use (|3.3ip . we have 



I 3 < lim ^K(-n 1/12 )) + ^ lim 0(n„(-n 1 / 12 ))(|n n (-n 1 / 12 )| + l)|V^r r , 
+ lim ^(-n 1/12 )+ lim <f>(-nV 12 )[\2b- 3 a n (0 n )\ + |6"V((9 n )/i/((9 n ) 

n— >-oo n— »oo 

+ lim |6- 3 a n (0 n )|^»(-n 1 / 12 ) ■ 

n— >oo 

= lim V^^K(-n 1/12 )) 



lim ^(-^ - n 1 / 12 + -L&n 1 / 6 ^ + o(l))) 



< lim V"^(-^ 1/12 + 1) = 0, 



hence 



h = 0. (3.38) 
As for I2, the fact of </>(y)|y| l , (i = 0,1,2) all being monotonically increasing on (2, 00) gives 



that 



h < lim v^(l - $(u„(n 1/12 ))) + lim v^(l - $(n 1/12 )) 
+1 lim <j){u n (n 1/12 )) |u„(n 1/12 ) 1 1 y/nr n \ 

D n— too 

+ lim ( ^(-n 1 / 12 )[|12fe- 3 a n (4)| + |&~V(0 n )/i/(0 n )|] 

n— >oo 

+ lim |6- 3 a n (0 n )</)(n 1 / 12 )n 1 /i 2 

n— >oo 

= lim Vn(l - ^(^(n 1 / 12 ))) + lim - ^(n 1 / 12 )) 

= 0, 



that is 



h = 0. (3.39) 
Then Theorem [27J follows right from ([37371) to (13739]) . 
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